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Consider  tlie  four-parameter  generalized  (iamma  population  with  loeation  param¬ 
eter  r,  m  ale  parameter  a,  Hhape/power  parameter  h,  ami  power  parameter  p  (ahape 
parameter  d  —  ftp'  ami  probability  density  function  /(r ;  r,  a,  li,  p )  m  p (r  — 
rxp  |— |(t  -  r)/a]' l/n1*  Ifli),  where  a,  h,  p  >  II  ami  z  >  r  >  (I.  The  likelihood 
equations  for  parameter  estimation  are  obtained  by  equating  to  rero  the  first  partial 
derivatives,  with  rcs|»ect  to  each  of  the  four  parameters,  of  the  natural  logarithm  of 
the  likelihood  function  for  a  complete  or  ecnsored  sample.  The  aaymptotie  variances 
and  covariances  of  the  maximum-likelihood  estimators  are  found  by  inverting  the 
information  matrix,  whose  components  are  the  limits,  os  the  sample  sire  n  — *  a,  of 
the  negatives  of  the  expected  values  of  the  second  partial  derivatives  of  the  likelihood 
function  with  respect  to  the  parameters.  The  likelihood  equations  cannot  be  solved 
explicitly,  but  an  iterative  procedure  for  solving  them  on  an  electronic  computer 
is  dcscriiicd.  The  results  of  applying  this  procedure  to  samples  from  Gamma,  Weibull, 
and  half-normal  populations  are  tabulated,  as  are  the  asymptotic  variances  and 
covariances  of  the  maxiinum-likclihood  estimators. 


1.  l.NTItOUUCTION 

•Stacy  [4]  him  Btudi«l  some  of  the  elementary  properties  of  a  threo-parnmeter 
generalized  Gamma  population  which  includes,  ns  special  cases,  not  only  the 
two-parameter  Gamma,  but  also  the  two-parameter  Weibull,  the  one-parameter 
exponential  and  half-normal,  and  other  imputations  of  interest.  Parr  and 
Webster  13]  have  obtained  expressions  for  the  maximum-likelihood  estimators, 
from  complete  samples  of  size  n.  of  the  parameters  of  such  a  population  and 
for  their  asymptotic  variances  and  covariances.  Stacy  and  Mihram  (5)  have 
reparameterized  the  population,  generalized  it  further  to  include  coses  in  which 
the  power  parameter  p  is  negative,  and  considered  estimation  of  parameters 
by  the  methods  of  moments,  maximum  likelihood,  and  minimum  variance. 

The  author  believes  that  the  usefulness  of  the  generalized  Gamma  population 
in  the  study  of  life  distributions,  which  has  been  recognized  by  Parr  and  Webster 
(3|,  will  be  greatly  enehanced  by  the  addition  of  a  fourth  parameter,  the  location 
parameter  c,  which  the  above  authors  have  assumed  to  be  zero.  In  addition, 
he  has  found  that  it  is  often  necessary  or  desirable  to  estimate  population 
parameters  from  censored  samples.  In  this  paper,  therefore,  by  the  methods 
already  employed  by  Harter  and  Moore  [2]  for  the  three-parameter  Gamma 
and  Weibull  populations,  he  formulates  an  iterative  procedure  for  maximum- 
likelihood  estimation,  from  complete  and  censored  samples,  of  the  parameters 
of  a  four-parameter  generalized  Gumma  population.  Harter  [1]  gives  the  mathe- 
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matical  formulation  and  tallies  for  the  asymptotic  variances  and  covariances 
of  the  Ml,  estimators.  A  one-page  excerpt  from  those  tables  is  included  in  this 
paper. 


2.  The  Foni-PAttAMF.TEn  Generalized  Gamma  Population 

The  probability  density  function  of  the  random  variable  X  having  a  four- 
parameter  generalized  Gamma  distribution  with  location  parameter  e,  scale 
parameter  a,  shape/power  parnmet. :  b,  and  power  parameter  p  (shape  parameter 


Tabls  I 

Corfieients  of  1  /N  Timet  Paver  of  Seale  Parameter  A  in  ML  Etlimalort,  from  Samplet 
of  Size  N  frith  Proportions  Qt  Censored  from  Below  and  Q1  from  Above,  of 
Parameters  of  Four- Para  meter  Generalized  Gamma  Population  with 
Shape /Power  Parameter  B  and  Power  Parameter  P 
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PoPUIATION  WITH  SHAPE  PARAMETER  3 
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d  —  bp)  is  given  by 

/(j;c.  a.  b,  p)  =  p(x  -  c)**'*  exp  |  -  [(x  -  c)/a]w\/al,r(b), 

a,  6,  p  >  0,  x  >  c  >  0.  (2.1) 

From  a  mathematical  standpoint  there  is  no  reason  why  c  cannot  be  negative, 
and  Stacy  and  Mihram  |51  have  introduced  a  simple  modification  which  allows  p 
to  be  negative,  but  since  negative  values  of  either  c  or  p  are  not  of  much  interest, 
at  least  from  the  point  of  view  of  life  distributions,  we  assume  that  c  and  p 
are  non-negative.  The  corresponding  cumulative  distribution  function  is  given  by 

Hr;  c,  a.  6,  p)  =  I\  T(6).  (2.2) 

The  fact  that  the  cumulative  distribution  function  of  this  population  is  an 
incomplete  Gamma-function  ratio,  as  is  that  of  the  Gamma  population,  suggests 
the  nani"  generalized  Gamma  population,  though  it  is  also  a  generalization 
of  the  three-parameter  Wei  bull  population  and  of  other  populations  as  well. 
Specifically,  one  may  mention  the  following  populations  as  special  rases:  three- 
parameter  Gamma  (p  =1);  three-parameter  Wcibull  {b  =  li;  two-parameter 
exponential  (b  =  p  —  1);  and  two-parameter  half-normal  (b  =  1/2,  p  =  2i. 
If,  in  addition,  one  sets  the  location  parameter  c  equal  to  zero  in  any  one  of 
these  populations,  the  result  is  the  same  population  with  the  number  of  param¬ 
eters  decreased  by  one. 


3.  Asymptotic  Variances  and  Covariances  or  ML  Estimators 

The  asymptotic  variancc-eovariance  matrix  for  the  maximum-likelihood 
estimators  6,  f,  p,  and  (  is  given  by  n  '[e,,l,  where  [e.,)  =  |i**')'1  and  the  v" 
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nrc  given  in  a  report  by  llarter  [1].  The  computation  of  the  clement*  v"  of  the 
information  matrix  (multiplied  by  t/n)  and  the  inversion  of  this  matrix  to 
obtain  the  coefficient*  of  1/n  in  the  variance-rovariance  matrix  were  performed 
on  the  IBM  7094  computer  for  various  values  of  the  parameters  b  and  p  and 
the  censoring  proportions  q,  (from  below)  and  q,  (from  above).  Computation  is 
quite  straightforward  when  the  shape  parameter  d  «■  bp  is  greater  than  2, 
but  when  the  shape  parameter  is  less  than  or  equal  to  2,  one  encounters  quantities 
which  become  infinite  when  qt  •=  0  and  take  the  indeterminate  form  ®  —  «, 
when  gt  >  0.  In  the  latter  case,  one  may  use  alternate  forms  which  are  finite 
and  can  be  evaluated  by  numerical  integration.  Estimation  Ls  non-regular 
and  hence  the  asymptotic  variances  and  covariances  of  the  estimators  have 
not  been  found  when  qt  «=  0  and  tho  shape  parameter  is  less  than  or  equal  to  2. 
With  this  exception,  the  coefficients  of  (l/»)  times  a  power  of  the  scale  parameter 
a  in  the  asymptotic  variances  and  covariances  wero  computed  for  q ,  =■  0.000 
(0.005)  0.025  and  q,  «  0.00  (0.25)  0.75  for  the  following  cases:  b  =  1,  p  =*  3 
(Wcibull  with  shape  parameter  3);  6  =  3,  p  *=  I  (Gamma  with  shape  param¬ 
eter  3):  b  »  1,  p  =*  2  (Weibull  with  chape  parameter  2);  b  =  2,  p  **  1  (Gamma 
with  shape  parameter  2);  5  **  p  ®  1  (exponential);  and  b  =  0.5,  p  «=  2  (half¬ 
normal).  Representative  results,  accurate  to  within  a  unit  in  the  last  place 
given,  nrc  shown  in  Tnble  1,  arranged  in  tho  form 

n  Var  (4)/n’  n  Cov  (4.  t)/a  n  Cov  (4,  f)/a  n  Cnv  (4.  £)/a' 

n  Var  (5)  n  Cov  (f*.  p)  n  Cov  (5,  S)/a 

n  Var  (p)  n  Cov  (fi,  Q/a 

«  Var  (£)/a’ 

4.  Iterative  Procedure  for  Obtaining  ML  Estimates 

The  maximum-likelihood  estimates  of  tho  parameters  are  the  solutions  of 
the  likelihood  equations  obtained  by  equating  to  zero  the  first  partial  derivatives 
of  the  likelihood  function  with  respect  to  the  parameters,  which  are  given  in 
a  report  by  Harter  [1].  Since  these  equations  do  not  have  explicit  solutions, 
it  is  necessary  to  resort  to  iterative  solution  on  an  electronic  computer.  Three 
iterative  procedures  were  tried,  singly  and  in  various  combinations — the  rule 
of  false  position,  the  Ncwton-Raphson  method,  and  the  gradient  method.  The 
procedure  found  to  give  best  results  wr.s  a  hybrid  one,  in  which  the  rule  of  false 
position  was  used,  for  tho  first  120  iterations,  to  estimate  the  parameters, 
one  at  a  time,  in  tin.*  cyclic  order  a,  b,  p,  and  c,  omitting  any  assumed  to  be 
known.  Assuming  that  .ho  first  m  order  statistics  of  a  sample  of  size  n  (m  <  n) 
arc  known,  one  starts  by  sotting  r  «»  0  (no  censoring  from  below).  One  then 
chooses  initial  estimates  for  ’.ho  unknown  parameters.  At  each  step,  one  deter¬ 
mines  the  value  'if  my)  of  the  parameter  then  being  estimated  which  satisfies 
the  appropriate  likelihood  u.ixfion,  in  which  the  latest  estimates  (or  known 
values)  of  the  other  tl.rw  piu.-tmctois  have  been  substituted.  Positive  values 
4,  S,  and  ft  cm  always  lie  fount*  in  this  way.  In  estimating  c,  however,  one  may 
find  that  no  value  of  <  in  the  permissible  interval  0  <  c  <  r,  satisfies  the 
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likelihood  equation  obtained  liy  equating  to  zero  the  partial  derivative  with  n- 
xpcvt  to  e.  In  such  casixi,  tin*  likelihood  function  in  tlmt.  interval  is  either  mono¬ 
tone  decreasing,  so  that  c  ■=  0,  or  monotone  increasing,  so  that  r  -  x, .  The  hitter 
situation  occurs  when  fi/i  <  1,  since  then  the  partial  derivative  with  respect  toe, 
for  r  —  0,  contains  only  positive  terns.  ( )nce  that  Inis  occurred,  it  is  im|>oxsi!>le  to 
continue  iteration  with  r  =*-  0,  since  :•:<  ,w»  of  the  terms  in  the  likelihood  equations 
become  infinite,  so  it  is  necessary  to  censor  the  smallest  observation  r,  and 
any  others  equal  to  it  (r  observations  in  till).  Sultsixpiently,  xt  plays  no  role  in 
the  estimation  procedure  except  as  an  upper  bound  on  <?.  Iteration  continues 
until  the  results  of  successive  steps  agree  to  within  somo  assigned  tolerance. 
If,  however,  the  tolerance  has  not  l>con  met  by  the  time  120  iterations  have 
been  performed,  tin*  procedure  is  altered.  The  Newton-Rnphson  method  is 
used,  starting  with  the  121“  iteration,  to  estimate  the  three  parameters  a,  b, 
and  p  simultaneously.  This  is  alternated  with  estimation,  by  the  rule  of  false 
position,  of  the  parameter  r,  which,  lieenuse  it  is  restricted  to  the  closed  interval 
[0,  jr,|.  does  not  lend  itself  to  estimation  by  the  Newton-Raphson  method, 
which  might  yield  an  I'stiniate  outside  this  interval.  The  altered  procedure  is 
continued  until  the  tolerance  has  been  met  or  until  the  total  number  of  iterations 
reaches  1 100,  at  which  point  the  attempt  to  estimate  the  parameters  is  aban¬ 
doned.  This  particular  procedure  is  recommended  because  the  gradient  method 
is  the  most  slowly  converging  of  the  three,  while  the  Ncwton-Raphson  method 
converges  most  rapidly  if  the  estimates  are  already  quite  good,  but  behaves 
erratically  if  they  are  not,  ns  is  likely  to  be  the  ease  at  the  outset. 

5.  Numerical  Examples 

As  illustrations,  consider  the  simulated  life  tests,  each  on  forty  components, 
summarized  in  Table  2.  Wc  shall  suppose  that  the  “data”  represent  observed 
failure  times  (in  hours).  Actually,  they  were  obtained  by  approporinte  trans¬ 
formations  of  uniform,  exponential,  or  normal  random  numbers.  For  each  set 
of  data,  the  iterative  estimation  procedure  described  in  Section  4  was  carried 
out  for  m  =  10(10)40  in  the  following  eases:  (l)  all  four  parameters  unknown; 
(2)  any  three  parameters  unknown;  (3)  any  two  parameters  unknown;  and  (4) 
any  ono  parameter  unknown.  The  resulting  estimates  for  m  «  30,  40  are  shown 
in  Tablo  2.  The  number  of  iterations  required  tends  to  be  large  when  one  is 
estimating  b  and  p  simultaneously,  especially  from  censored  samples,  apparently 
because  of  the  fart  that  there  is  a  high  negative  correlation  between  6  and  j), 
so  that  their  product  2,  an  estimate  (not  ML)  of  the  shape  parameter  d,  tends 
to  be  more  stable  than  either  5  or  p. 

The  iterative  estimation  procedure  was  programmed  in  FORTRAN  and  run 
on  the  IBM  7094  computer.  Machine  time  tends  to  be  somewhat  excessive, 
averaging  aliout  a  minute  per  hundred  iterations  in  cases  in  which  three  or 
four  parameters  are  being  estimated. 

<>.  CoNCLuniNO  Remarks 

Asymptotic  variances  and  covariances  of  the  estimators  of  the  remaining 
parameters  when  one  or  more  of  the  parameters  are  known  have  been  calculated 
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for  various  parameter  values  and  censoring  proportions.  This  was  accomplished 
by  i overt i ns  all  square  subniatriees  of  the  information  matrix.  When  the  locution 
parameter  c  is  known,  estimation  is  regular  even  when  the  Rhapo  parameter  A  is 
less  than  or  equal  to  2,  so  it  was  possible  to  compute  asymptotic  variances  and 
covariances  of  the  estimators  of  the  other  parameters  for  the  cases  in  which 
<h  —  0,  A  <  2.  Because  of  space  limitations,  the  results  are  not  included  in  this 
paper. 

.In-',  how  applicable  the  asymptotic  variances  and  covariances  are  to  estimates 
from  sample  of  size  as  small  :is  40  is  an  open  question.  Conceptually,  this 
question  might  he  settled  hy  a  Monte  Carlo  study,  but  from  a  practical  stand¬ 
point  any  such  study  large  enough  to  la?  conclusive  would  he  ruled  out  by  the 
excessive  machine  time  required.  In  any  case,  the  estimates  given  by  the 
iterative  procedure  described  in  Section  4,  when  the  location  parameter  e 
is  unknown,  differ  in  two  important  respects  from  those,  for  which  asymptotic 
variances  and  covariances  have  been  calculated,  which  assume  that  at  least 
one  observation  is  censored  from  below  whenever  the  Rhape  parameter  d  is 
less  than  or  equal  to  2  and  that  negative  values  of  the  estimate  6  of  the  location 
parameter  are  permitted.  Violation  of  either  of  these  conditions  vitiates  the 
property  of  asymptotic  multivariate  normality  and  changes  the  asymptotic 
variances  and  covariance*.  Nevertheless,  the  author  believes  that,  when  it 
converges,  the  iterative  procedure  described  in  Section  4,  which  viola  i  s  both 
of  these  conditions,  results  in  more  realistic  estimates.  Moreover,  tho  restriction 
of  c  to  be  non-negntivc  results  obviously  in  a  reduction  (which  may  be  substantial 
when  d  is  large  and  n  and  c/a  are  small)  in  the  variance  of  t,  and  probably, 
because  of  the  high  correlation  between  the  estimators,  in  a  reduction  in  tho 
other  variances  and  covariances.  A  comparison  of  the  discrepancies  of  the 
estimates  given  in  Table  2  for  the  cases  in  which  d  =  3  from  the  true  values  of 
the  parameters  with  those  which  one  might  expect  if  the  asymptotic  formulas 
held  tends  to  confirm  that  such  reductions  do  occur. 
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IS  ABS1NAC T 


Consider  the  four-parameter  generalized  Gamma  population  with  location  parameter  c. 


equations  for  parameter  estimation  are  obtained  by  equating  to  zero  the  first 
partial  derivatives,  with  respect  to  each  of  the  four  parameters,  of  the  natural 
logarithm  of  the  likelihood  function  for  a  complete  or  censored  sample.  The 
asymptotic  variances  and  covariances  of  the  maximum-likelihood  estimators  are 
found  by  inverting  the  information  matrix,  whose  components  are  the  limits,  as  the 
sample  size  n  -*  ,  of  the  negatives  of  the  expected  values  of  the  second  partial 
derivatives  of  the  likelihood  function  with  respect  to  the  parameters.  The  likeli¬ 
hood  equations  cannot  be  solved  explicitly,  but  an  iterative  procedure  for  solving 
them  on  an  electronic  computer  is  described.  The  results  of  applying  this  procedure 
to  samples  from  Gamma,  Weibull,  and  half-normal  populations  are  tabulated,  as  are 
the  asymptotic  variances  and  covariances  of  the  maximum-likelihood  estimators. 
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